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Abstract 

A path information is defined in connection with different possible 
paths of irregular dynamic systems moving in its phase space between 
two points. On the basis of the assumption that the paths are physi- 
cally differentiated by their actions, we show that the maximum path 
information leads to a path probability distribution in exponentials of 
action. This means that the most probable paths are just the paths 
of least action. This distribution naturally leads to important laws 
of normal diffusion. A conclusion of this work is that, for probabilis- 
tic mechanics or irregular dynamics, the principle of maximization of 
path information is equivalent to the least action principle for regular 
dynamics. 

We also show that an average path information between the initial 
phase volume and the final phase volume can be related to the entropy 
change defined with natural invariant measure of dynamic system. 
Hence the principles of least action and maximum path information 
suggest the maximum entropy change. This result is used for some 
chaotic systems evolving in fractal phase space in order to derive their 
invariant measures. 
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1 Introduction 



This work is an investigation, in connection with the concepts of information, 
entropy and least action principle of Maupertuis, of the thermostatistics of 
dynamic system arbitrarily away from equilibrium. It is hoped that the re- 
sults may have some connections with quantum gravity theories, quantum 
cosmology and quantum chromodynamics in particle physics because, firstly, 
most, if not all, of the systems treated in these fields are in nonequilibrium 
state and, secondly, the statistical concepts of probability, information, en- 
tropy and least (stationary) action solutions (instantons) to Feynman path 
integrals are so essential and widely used in these disciplines [1]. An im- 
portant character of the path integral methods is that the probability of 
certain evolution is determined by an exponential functional of action which 
is postulated for the first time by Feynman[2]. The reader will find that 
this is a natural consequence of the principle of maximum path information 
combined with action of the trajectories of nonequilibrium evolution. 

Although the theoretical formalism of equilibrium statistics is well founded 
on the physical laws with the help of the algorithm of maximum entropy [3, i], 
the present statistical methodology for nonequilibrium systems seems to some 
extent uncertain[5]. For some nonequilibrium systems, the extension of the 
concept of Boltzmann and Gibbs entropies are in progress [5, 6, 7]. For sta- 
tionary state sufficiently close to equilibrium, the principle of minimum en- 
tropy production is proposed[S]. For certain systems far from equilibrium, 
e.g., in the context of the climate of earth, there is the method of maximum 
entropy production (or minimum entropy exchange) [9, 10]. Here the entropy 
is always in the sense of Clausius, so the entropy production dSi > ac- 
cording to the second law. Recently, we have witnessed the development of 
nonextensive statistics theories based on the Tsallis entropy which has been 
maximized for nonequilibrium systems[ll, 12] in chaotic motions or on the 
edge of chaos according to actual understanding. This is nothing but an ex- 
tension of Jaynes principle for nonequilibrium systems[13] to another entropy 
which is not necessarily an entropy in the sense of Clausius. 

This work is intended to study the behavior of irregular dynamic systems 
from the point of view of information theory. It is expected that the reasoning 
of this work concerning the principle of maximum information and entropy 
in connection with the concept of action and the principle of Maupertuis, 
can be helpful for understanding the physics of dynamic processes. In the 
second part of this paper, we specify some definitions and assumptions used 
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in this work. In the third part, we describe a path information [11] defined in 
connection with different possible paths of nonequilibrium systems moving 
in its phase space between two points (cells). On the basis of the assump- 
tion that the paths are physically differentiated by their actions, we show 
that the maximum path information yields an exponential path probability 
distribution depending on action which implies the most probable paths are 
just the paths of least action^. Finally, this least action distribution is differ- 
entiated with time and position in order to derive, in a quite general manner 
without additional assumptions, the Fokker-Planck equation, the Pick's laws 
of normal diffusion, the Ohm's law of electrical conduction and the Fourier's 
law of heat conduction. 

In the forth part, an averaged path information is related to the differ- 
ence of entropy between two phase volumes. The entropy is defined with 
the natural invariant measure of the nonequilibrium system. This relation- 
ship suggests that, if one maximizes path information in order to know the 
probability distribution of paths for dynamic systems whose motion forms 
geodesic flows in phase space, the entropy change of the dynamic process 
must be maximized in order to derive the invariant measures of the process. 

Finally, the above result is applied to some chaotic systems evolving in 
fractal phase space for which a relative entropy change is given by -R = 
J2i l^i ~ Hi lA^ where g is a positive real parameter characterizing the ge- 
ometrical features of the phase space and /Xj a natural invariant measure. 
Its maximization (or extremization) with appropriate constraints can yield 
several power law invariant measures. 

2 Assumptions and definitions 

Let us begin by some assumptions and definitions which specify the range of 
validity of this work. 

1. Phase space and partition. As usual the phase space F of a thermo- 
dynamic system is defined such that a physical state of the system is 

^During the preparation of this manuscript, Dr. Touchettc wrote me that this connec- 
tion was known in the field of random perturbation of dynamic systems and large devi- 
ation. The possible references arc: M.I. Freidlin, A.D.Wentzell, Random Perturbations 
of Dynamic Systems, Springer- Verlag, 1983; and Y. Oono, Large deviation and statisti- 
cal physics, Progress of Theoretical Physics Supplement 99, 165-205, 1989. I am most 
indebted to him for pointing out that. 
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represented by a point in that space. For a A^-body system moving in 
three dimensional ordinary configuration space, the F-space is of 6A^ 
dimension (3A^ positions and 3A^ momenta) if it can be smoothly occu- 
pied. The position of the state point at t = of a movement is called 
initial condition of that movement. We suppose that a phase volume 
Q accessible to the system can be partitioned into v cells of volume Sj 
with i = 1,2, ...V in such a way that Sj fl = (z 7^ j) and U^^^^Sj = Q. 
A state of the system can be represented by a sufficiently small phase 
cell in coarse graining way. The movement of a dynamic system can 
be represented by its trajectories (in the sense of classical mechanics) 
in F space. 

2. The natural invariant measure [17] fii (probability distribution for a 
nonequilibrium system to visit different phase cells of given partitions) 
is defined for the cell i as follows : 

/ij = / dxp{x) (1) 

J Si 

where p{x) is the probability density and x represents the phase po- 
sition. For dynamic systems viewed as geodesic fiow in phase space, 
the phase trajectories is uniformly distributed in the accessible phase 
volume [15]. In this case, p(x) can be constant over all the phase space 
and /ij becomes proportional to Sj, a phase cell of a given partition. 
This property will be useful for calculating entropy change of a system 
moving in fractal phase space (see below). 

3. The ergodicity for nonequilibrium system is described by 

which means that the average over time is equal to the ensemble average 
over the occupied phase space volume, where T is the period of the 
evolution, Q{t) is the value of a quantity Q at time t and Qi is the 
value of Q in the cell i. In this way, the evolution of information 
over time can be estimated by the time evolution of the phase space 
volume occupied by the statistical ensemble of identical systems under 
consideration. 
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4. The information we address in this work is our ignorance about the 
system under consideration associated with some uncertainty or prob- 
abihty distribution. According to Shannon, this information can be 
measured by the formula 

V 

H = -^pilnpi (3) 

i=l 

with respect to certain probabihty distribution pi and the index i is 
summed over all the possible situations or events. 

5. In this work, entropy S* of a nonequilibrium system is defined with the 
natural invariant measure /ij either by Eq.(3) or by other formula, i.e., 

V 

5* = — /ij In/ij = — / p{x)\np{x)dx (4) 
i=i 

or, more generally, S = o-[p{x)]dx , where Q is the total occupied 
phase volume and a is the entropy density. In the special case of 
Eq.(4), (t[p(x)] = p{x) Inp(x). 

6. According to the ergodic assumption mentioned above, the entropy 
change AJ(T) of a dynamic system during a long time process can be 
estimated by the ensemble average of the entropy change during the 
scale refinement, 



A/(r) = hm i ^6^m (5) 

T^oo I Jo 

°°i=l •^■'<' j=l •>^J 



where A/(T) is the average entropy change during the time T, 5i{t) is 
the entropy change at time t, cxj is the density of information on the 
phase cell i of volume Sj, vt and vq are the total numbers of the cells of 
phase space accessible to the system and visited by the trajectories at 
time t = T and t = 0, respectively. According to our assumption, the vt 
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cells visited by the system form a geometry which can be reproduced by 
the Vk cells yielded from the Vq cells by certain map (scale refinement) 
of k iterations. We may put Vk = vt when k and T are large. 



3 About a path information 

3.1 Uncertainties of irregular dynamics 

In a previous work[l 1], we defined a path information for irregular dynamic 
systems moving in the F-space between two points, a and 6, which are in two 
elementary cells of a given partition of the phase space. It is known that if 
the motion of the system is regular, there will be only a fine bundle of paths 
which track each other between the initial and the final cells and minimize 
action according to the principle of least action[15]. However, if the dynamics 
is irregular due to large number of degrees of freedom or strong sensitivity 
to initial conditions, we can have the following two dynamic uncertainties: 

1. Between any two fixed cells a and 6, there may be different possible 
paths (labelled by fc=l,2,...w) each having a probability pfc(6|a) to be 
followed by the system. This is the uncertainty we studied in [14]. 

2. In a fixed period of time, we can observe different possible paths leaving 
the cell a and leading to different final cells 6 in a final phase volume 
B, each having a probability to be followed by the system. 

In this section, the discussions will be made with the first uncertainty. By 
definition, the path probability distribution Pfc(&|a) is a transition probability 
from state a to state h via path k for all systems between these two states. 
We have YJk=i'Pk{b\o) = 1- The dynamic uncertainty associated with. pk{b\a) 
is measured by the Shannon information : 



H[a, b) is a path information, i.e., the missing information necessary for pre- 
dicting which path a system takes from a to b. 



w 




(6) 



k=l 
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3.2 Least action distribution 



The path probabihty distribution pk{b\a) due to dynamic irregularity can 
be studied in connection with information theory and action integral on the 
basis of the assumption that the different paths are uniquely differentiated by 
their actions. For classical mechanical systems, action is given by 



Aab{k) = / Lk{t)dt (7) 

where Lk{t) is the Lagrangian of the system at time t along the path k. For 
other systems, the action may be given by different calculations, e.g., Yang- 
Mills action and Euclidean action for quantum field theory and quantum 
cosmology [1]. The average action between state a and state b is given by 

UI 

Aab = Y.Pkib\(^)^-bik). (8) 

k=l 

The maximization of H{a, b) under the constraints associated with the 
normalization of Pk{b\a) and the average action leads to 

Pk{b\a) = ^exp[-r]Aabik)] (9) 

Putting this distribution into H{a, b) of Eq.(6), we get 

if(a,6) = In Q + r/A,t, = In g-r/^ In g (10) 

orj 

where Q is given by g = YX=i^^V>[-'nAab{k)] and Aab = --§^\nQ. 

It is proved that [14] the distribution Eq.(9) is stable with respect to the 
fluctuation of action, and that Eq.(9) is a least (stationary) action distribu- 
tion, i.e., the most probable paths are just the paths of least action. We 
have indeed 6pk{b\a) = —r]pk{b\a)6Aab{k) = 0, so that 6Aab{k) = leading 
to Euler-Lagrange equation ^^^p- — ^^r^ = 0[15] and to Newton's second 
law which are satisfied by the most probable paths. For stochastic process 
like Brownian motion[16], it can be proved[l I] that the Lagrange multiplier 
rj is positive and given by the inverse of the diffusion coefficient rj = 
So the action of Brownian particles has a minimum along the most probable 
paths. 
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The physical content of rj can be made clearer if we use the general rela- 
tionship D = ^ for Brownian motion leading to 

where / is the mean free path and r the mean free time of the Brownian 
particles. If we still consider detailed balance[16], we get D = fiksT where 
/i is the mobility of the diffusing particles, ks the Boltzmann constant and 
T the temperature. This means 

V = = ^— (12) 

' 2mfiKBT 2KbT ^ ' 

where 7717 = ^ is the friction constant of the particles in the diffusion mixture. 
Eq.(9) can now be written as 

p,(%) = -exp[-^^] (13) 

3.3 A calculation of transition probability 

Now let us look at a particle of mass m diffusing along a given path from a 
to a cell b of its /i-space (one particle phase space). The path is cut into 
infinitesimally small segments each having a spatial length Axj = Xj — 
with i = 1...N {xq = Xa and x^ = Xf,). t = ti — is the time interval spent 
by the system on every segment. The Lagrangian on the segment i is given 
by 

Ti • ,N m{xi-Xi.if (dU\ (x,-Xi_i) 

L(X,X,t) = U(Xi^i) 14 

where the first term on the right hand side is the kinetic energy of the particle, 
the second is the average increment of its potential energy and the third is 
its potential energy at the point The action on the segment i is just 

Ai = + Fi^t - U{xi^,)t, (15) 



where Fi = — (^) is the force on the segment i. According to Eq.(9), the 
transition probability Pi/i^i from to Xi on the path k is given by 



—Axj + Fi-Axi 
2t ' 2 



(16) 
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where Zj is calculated as follows 



dxi exp ( —r] 

3 



—Axj + Fi-Ax, 
2t ' 2 



(17) 



exp 



' 8m 



2TTt 

mrj 



The potential energy at the point Xi-i disappears in the expression of 
because it does not depend on Xj. 
The total action is given by 



N 



N 



i=l 



i=l 



m(Axj 



t 



2^ +F,-Ax, -f/(x,_i)t 



(18) 



J k 



SO the transition probability from a to 6 via the path is the following: 



Pk{h\a) 



N 



^exp 

TV 
i=l 



i=l 



m(Ax 



t 



+ Fi-Axi 
2t "2 



(19) 



where 



N 



N 



Z = ]J = J]^ exp 



2=1 



i=l 



* 8m 



/27ri 
mr] 



(20) 



3.4 A derivation of diffusion laws 
3.4.1 Fokker-Planck equation 

The Fokker-Planck equation describes the time evolution of the probability 
density function of position and velocity of a particle. This equation can be 
derived on the basis of the assumptions of Brownian motion and Markovian 
process[16]. We will show here that this equation can be derived from the 
distributions given by Eq.(16) and Eq.(19) without any assumptions. 

The calculation of the derivatives -^-^p^, ^'^'g^'!''^ and ^ g'^^"^ straightfor- 
wardly leads to 

^Pi/^^l ^ r d{FiPii,^i) ^ ^ d'^Pi/i^i 
dt m dxi dxi 
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This is the Fokker-Planck equation, where D is given hy D = and r 
is the mean free time supposed to be the time interval t of the particle on 
each segment of its path. In view of the Eq.(19), it is easy to show that 
this equation is also satisfied by Pk{b\a) if Xi is replaced by xi, or x, the final 
position. Now let Ua and rii, be the particle density at a and b, respectively. 
The following relationship holds 

w 

nb = ^ naPk{b\a) (22) 

k=l 

which is valid for any Ha- This means (let n = Ub and x = Xb)'- 

dn _ T d{Fn) ^ ^d'^n 
dt m dx dx"^ ' 

which describes the time evolution of the particle density. 

3.4.2 Fick's laws of diffusion 

If the external force F is zero, we get 

This is the second Fick's law of diffusion. The first Fick's law 

J(x,t) = -D|^ (25) 

can be easily derived if we consider matter conservation ^"g^'*-* = — ^^f^ 
where J{x, t) is the flux of the particle flow. 

The diffusion constant D can be related to the partition function Za by 
combining the relationship D = and Eq.(lO), i.e., 

2mdHa 2m dHadrj ^ ' 

3.4.3 Ohm's law of electrical conduction 

Considering the charge conservation ^^^^ = ~^^^§f^-, where p(a:, t) = qn{x, t) 
is the charge density, j{x,t) = qj{x,t) is the flux of electrical currant and q 
is the charge of the currant carriers, we have, from Eq.(23), 
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where F = qE is the electrostatic force on the carriers and E is the electric 
field. If the carrier density is uniform everywhere, i.e., |^ = 0, we get 

j = -qEp = aE, (28) 
m 

2 

where a = — = is the formula of electrical conductivity widely used 

mm J J 

for metals. 



3.4.4 Fourier's law of heat conduction 

For heat conduction, let the external force F be zero. We consider a crystal 
idealized by a lattice of identical harmonic oscillators each having an energy 
Cfc = Njj{x^ t)hv where h is the Planck constant, v is the frequency of a mode 
and N^{x, t) is the number of phonons of that mode situated at x at time t in 
the intervals x x + dx and u ^ 1/ + dv. Suppose that there is no mass flow 
and other mode of energy transport in the crystal. Heat is transported only 
through the phonon flow. The phonons of frequency v diffuse in the crystal 
lattice, among the lattice imperfections, impurities and other phonons with 
in addition anharmonic effects[19], just like a particle of mass m = hvjc? 
having transition probability pfc(6|a). Let = N^/dx be the density of 
phonons which must satisfy 



t) n^{xa, t)pk{b\a) (29) 



and also Eq.(24). 

The total energy density p{x, t) of phonons at x and time t is given by 

p(x,t) = / hvny{x,t)Q{v)dv, (30) 
Jo 

where Q{v)du is the mode number in the interval z/ — > i/ + du, and Vm is the 
maximal frequency of the lattice vibration. This relationship holds for any 
state density q{v) and frequency v. This implies 

^^ = DA.p(x,t) (31) 

On the other hand, the variation of energy density 5p{x, t) can be related 
to temperature change 6T{x, t) by 

Sp{x,t) = c6T{x,t) (32) 
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where c is the heat capacity per unit volume supposed constant everywhere 
in the crystal. This leads to 

|^ = KA,T(x,t) (33) 
where k = Dc is the heat conductivity. This equation can be recast into 

c^^|^ = «:A.T(x,t) (34) 

which describes the evolution of temperature distribution due to the heat 
flow. When a stationary state is reached, temperature is everywhere con- 
stant, i.e., ^'^g^'*-' = AxT(x,t) = 0, and the temperature distribution is given 
by VxT{x) = constant. 

Now considering the energy conservation in an elementary volume be- 
tween X and X + dx in which we have — ^^^q/^ = ■ J{x, t), Fourier's law of 
heat conduction follows 

J{x,t) = -KV:,T{x,t). (35) 

Summarizing this section, we have introduced a path information a la 
Shannon for irregular dynamic systems and assumed that the different paths 
between any two flxed points in phase space are characterized by their ac- 
tions. This starting points lead to a least action transition probability in 
exponentials of action which maximizes the path information and implies 
that the most probable paths are just the paths (geodesies) required by the 
least action principle of classical mechanics. From this least action distribu- 
tion, we can derive important physical laws for normal diffusion without any 
additional assumptions about the dynamic process (Brownian and Markovian 
or not). This result can be considered as a robust support to this approach 
of probabilistic mechanics or statistical dynamics. In what follows, the above 
method concerning only two flxed phase cells will be extended to arbitrary 
flnal cell b in order to study the variation of entropy of dynamic process from 
the point of view of path information. 



4 Maximize entropy change for nonequilib- 
rium systems 

Now the above result concerning only two flxed cells will be generalized to 
arbitrary destination b. Let us consider an ensemble of N identical chaotic 
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systems leaving the initial cell a for some destinations. The travelling time 
is specified, say, tab = h — ta- After tab, all the phase points occupied by the 
systems form the final phase volume B partitioned into cells labelled by h. 
We observe A*";, systems travelling along an ensemble of paths labelled also by 
b leading to certain cell h. A path probability can be defined by pi,\a = N^/N 
which is normalized by Y.bV^a = 1- We always suppose each ensemble of 
paths h is characterized by the average action Aab over the ensemble given 
by Eq.(8). Then a total average action can be defined by Aa = J2bPb\aAab- 
The uncertainty concerning the choice of final cells is just the second uncer- 
tainty mentioned in section 3.1. It is measured by the following Shannon 
information 

Ha = -"^Pbla^l^Pbla (36) 
b 

and can be maximized just as in section 3.2 to give 

Pb\a = ^exp[-eAab], (37) 

where 6 is the Lagrange multiplier associated with Aa- As has been done 
for the distribution of Eq.(9) in [14], it can be proved that this distribution 
is stable with respect to the fiuctuation of the average action Aab- It has 
also been proved in [1 1] that Aab has a stationary (minimum if r/ > and 
maximum if 77 < 0) when the uncertainty (path information) H{a, b) is max- 
imized. This means that the ensemble of paths with stationary Aab are the 
most probable, i.e., 6Aab = <^=^ Spb\a = 0. 

Our aim here is to derive the invariant measures fii which define the 
entropy S for dynamic systems by Eq. (4) or, more generally, by certain func- 
tional cr[p(a;)]. Our idea is to "complement" the method of maximum entropy 
by another method for dynamic systems. This is the method of maximum 
entropy change. 

In what follows, we suppose that entropy changes when an irregular dy- 
namic system moves from the initial cell a to the final cells b in B. The initial 
entropy of the systems at time t = is given by Shannon formula: 

over A 

Sa = - 1^ (38) 

a 

where fia is the invariant measure of the systems in the initial phase volume 
A ai t = and the cell index a is summed over all A. After a time tab, the 
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systems from the cell a travelling along an ensemble b of paths are found in a 
cell b with invariant measure /i;,(a). Supposing Markovian process, we have 



fJ'bia) = fiaPb\a- (39) 

We calculate first the contribution of the cell a to the final entropy of the 
systems in B. It is given by 

Sb{a) = fib{a) In fib{a) (40) 

b 

b 

The total final entropy is then 

Sb = -J2Sb{a) (41) 

a 

a a b 

= Sa + ^ jJ'aHa = Sa + Ha, 
a 

where Ha is the average of the path information Ha over all the initial phase 
volume A. So if Ha is maximized, Ha should also be maximized. 

Eq.(41) is an essential result of this work. It states that, if Ha as well as 
Ha must be maximized by the least action distributions, then the entropy 
change AS* = Sb — Sa = Hb\a must be also maximized for dynamic process. 

We would like to emphasize here that maximum (extremum) entropy 
change does not exclude the possibility of maximum (extremum) entropy. 
In fact, if the entropy change is maximized at any moment of an evolution, 
the entropy must also be at maximum all the time. This can be considered 
as a proof of the maximum entropy method derived from action principle 
for stochastic process. The choice of these two methods for a given process 
of course depends on which of entropy and entropy change is available for 
the probability functionals to be derived. Following section is an example of 
the availability of entropy change without even knowing the exact entropy 
functionals. 
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5 The entropy change due to fractal geome- 
try 

Now let us use the method of extremum entropy change (an extension of 
maximum entropy change) to derive invariant measure of dynamic systems. 
We consider a statistical ensemble of identical dynamic systems all moving 
in fractal phase space. The outcome of this movement is not specified. This 
may be a relaxation process towards equilibrium or a long evolution from one 
nonequilibrium state to another. For this kind of systems, an entropy change 
has been derived in our previous work[L'S] in term of invariant measures. We 
give here a brief description of the method of maximum entropy change and 
some of its consequences. 

In reference [18], we supposed that all state points in the phase space 
were equiprobable and uniformly distributed in the initial condition volume. 
This is true if the ensemble of studied systems forms geodesic flows on phase 
manifolds [15]. In this case, the invariant measure Hi of a phase cell i of a 
given partition is just proportional to the volume Si of the cell. We supposed 
in addition the state density is scale invariant, which is in accordance with the 
time independent invariant measure if we consider the ergodic assumption. 
In this case, the relative entropy change from zeroth to A*'' iteration of the 
scale refinement (finer and finer partition of the phase space) is given by 

R = Y.(^^^-^A) (42) 

i=l 

where i is the index and vx is the total number of the cells of a phase partition. 
q should be considered as a parameter characterizing the topological feature 
of the phase space. If the phase space is a simple fractal with dimension 
df, we have q = df/d where (i is the dimension of the phase space when it 
is smoothly occupied. Eq.(42) is originally derived with the hypothesis of 
incomplete information and incomplete probability distribution for fractal 
phase space[18]. But its form remains the same for complete probability 
distribution pi (i.e. J2^^iPi = !)• The following presentation is made within 
this formalism. 

R has the following properties 

1. i? is a relative change, so — 1 < i? < 1. 
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2. 



For a system composed of two sub-systems A and B with and qb 
satisfying the following rule of product joint probability 



it is easy to show the following nonadditivity : 

R{A + B) = R{A) + R{B) + R{A)R{B). (44) 

3. R is positive and concave for q > 1, and negative and convex for g < 1. 
If g = 1, there is no fractal, so i? = 0. In other words, the fractal 
feature of the phase space is responsible for the entropy change. This 
is in accordance with the numerical result for some chaotic maps[20]. In 
the case of a simple fractal, q = df/d > 1 (g = dj/d < 1) implies phase 
space expansion (contraction) during scale refinement. So for chaotic 
dynamic systems, g > 1 corresponds to positive Lyapunov exponent 
(we lose knowledge about the system so that R > 0) and g < 1 to 
negative Lyapunov exponent (we gain knowledge about the system so 
that R<0). 

4. We see that i? is a function of the dimension difference df — d. If we 
divide by g — 1 = ^^^^j^, we get 

H, = ^ = -^l^lil^l^. (45) 
g — 1 1 — <? 

This is the form of Tsallis entropy[ll]. If g = 1 or (ij = c?, the phase 
space is uniformly occupied and the ratio Hi becomes Shannon entropy. 
Other extended entropies can be obtained by defining entropy change 
rate in different manners[18]. 



6 Some invariant measures for chaotic sys- 
tems 

According to our method, R can be extremized under the constraints associ- 
ated with the normalization /^i = 1 and with our knowledge about the 
random variables x^"'^ (cr = 1, 2...W is the index of these variables) concerned 
in the nonequilibrium process, with w multipliers 7^ each connected with 
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an expectation x^'^^ = Yli=i f'-i^i where xj is the value of x^"^ when the 
system is at the state i. The probabihty distribution is given by 

/^. = ^(1-E7.a:r^)^/^^-^^. (46) 

^ a=l 

This distribution can be apphed to many chaotic maps. Following are some 
examples. 

6.1 Un model for population evolution 

The logistic map yn+i = Ayn - Byl (0 < yn < |/max)[21] is often used for 
modelling the biological population evolution, where ?/„ is the population of 
the n*^ year or of n*'* order of iteration, ymax = A/ B is the maximal popula- 
tion (for given living conditions) not to exceed in order that the concerned 
species do not die out next year, A is a positive constant connected with pop- 
ulation growth and 5 is a positive constant connected with the population 
decrease. 

In this model, the two variables for the population evolution is Xn and 
x"^. So if in Eq.(46) one puts x^^^ = y and x^"^^ = y^, one gets, 

/i(x) = ^(1 - E i.xl^^Y^^'"'^ = ^(1 - 7iy - i2y'Y^^'-'^. (47) 

^ (7=1 ^ 

According to the assumption of the roles of the y-term and y^-term in the 
population evolution, we can suppose that 71 is related to population increase 
and 72 to population decrease. When •jiy + 72^/^ ^ 1, Eq.(47) becomes 

Kx) = ^i-iiy-72y'Y/^'-'^. (48) 

By comparison with the distribution given for A = 4 [21] : fi{x) = ^[^.(■]^^^-)]i/2 
where x = y/ymax, we obtain 71 = -ymax, 72 = 1, Q = Tr/ymax and q = 3. So 
R > 0. This implies an increasing entropy process with positive Lyapunov 
exponent . 

6.2 The continued fraction map 

The continued fraction map[r7] is a chaotic map given by Xn+i = l/x„ — 
[l/x„] where [l/x„] is the integer part of l/x„ and X fi IS 3j real number 
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between and 1. The probability distribution is given by = 1/ (1+x) In 2 
and satisfies J2x f^i^) = 1- This distribution can be obtained from Eq.(46) 
by using w = 1, x^^^ = x, 71 = —1, Q = ln2 and q = 2. This is also an 
increasing entropy process with Lyapunov exponent A = ln2[17]. 

Other apphcation can be found in [18], e.g., for Ulam map Xn+i = 1 — /xx^ 
(— 1 < Xn < 1) with /i = 2, g = 3 and for Zipf-Mandelbrot's law = 

7 Concluding remarks 

A path information is defined in connection with different possible paths of 
chaotic system moving in its phase space between two cells. On the basis of 
the assumption that the paths are physically differentiated by their actions, 
we show that the maximum path information leads to a path probability 
distribution in exponentials of action from which the well known Fokker- 
Planck equation, the Pick's laws, the Ohm's law and the Fourier's law can 
be easily derived in a general way. This result strongly suggests that, for 
the probabilistic case of irregular dynamics, that the principle of least action 
for regular dynamics should be replaced by the principle of maximization of 
path information or dynamic uncertainty. 

We show that an extended path information between two phase volumes 
can be related to the entropy change of the processes linking the two phase 
volumes. Hence the principles of least action and maximum path information 
suggest the maximum entropy change which can be used to derive the most 
probable invariant measures for nonequilibrium systems. This result is used 
to derive invariant measures for some chaotic systems evolving in fractal 
phase space. We would like to emphasize that the method of maximum 
entropy change is in accordance with the principle of maximum entropy which 
can be used for nonequilibrium systems when available. If the system of 
interest occupying the two phase volumes is in equilibrium, then maximum 
entropy change of dynamic process linking the phase volumes naturally leads 
to the Jaynes' principle of maximum entropy for equilibrium systems, as 
discussed in [22]. 



18 



Acknowledgments 



I acknowledge with great pleasure the useful discussions with Professors A. 
Le Mehaute, F. Tsobnang, L. Nivanen, M. Pezeril and Dr. W. Li. 

References 

[1] S.W. Hawking, T. Hertog, Phys. Rev. D, 66(2002)123509; 

S.W. Hawking, Gary.T. Horowitz, Class. Quant. Grav., 13(1996)1487 

S. Weinberg, Quantum field theory, vol.11, Cambridge University Press, 
Cambridge, 1996 (chapter 23: extended field configurations in particle 
physics and treatments of instantons) 

[2] R.P. Feynman, Quantum mechanics and path integrals, McGraw-Hill 
Publishing Company, New York, 1965 

[3] E.T. Jaynes, The evolution of Carnot's principle, The opening talk at 
the EMBO Workshop on Maximum Entropy Methods in x-ray crystal- 
lographic and biological macromolecule structure determination, Orsay, 
France, April 24-28, 1984; Reprinted in Ericksen & Smith, Vol 1, pp. 
267-282; Phys. Rev., 106,620(1957) 

[4] M. Tribus, Decisions Rationelles dans Vincertain, (Paris, Masson et Cie, 
1972)P14-26; or Rational, descriptions, decisions and designs, (Perga- 
mon Press Inc., 1969) 

[5] D. Ruelle, Is there a unified theory of nonequilibrium statistical me- 
chanics? Proceedings of the International Conference on Theoretical 
Physics Th-2002 (Paris, July 22-27, 2002), Birkhauser Verlag, Berhn, 
2004, p.489; 

D. Ruelle, Extending the definition of entropy to nonequilibrium steady 
state, Proc. Nat. Acad. Sci., 100,30054(2003) 

[6] G. Gallavotti, E.G.D. Cohen, Note on nonequilibrium stationary states 
and entropy, cond- mat/0312306 

[7] P.L. Garrido, S. Goldstein and J.L. Lebowitz, The Boltzmann entropy 
for dense fluid not in local equilibrium, cond-mat/03 10575 



19 



S. Goldstein and J.L. Lebowitz, On the (Boltzmann) Entropy of 
Nonequilibrium Systems, cond-mat/0304251 



[8] I. Prigogine, Bull. Roy. Belg. CI. Sci., 31,600(1945) 

[9] G. Paltridge, Quart. J. Roy. Meteor. Soc., 101,475(1975) 

[10] Tim Lenton, Maximum entropy production in Edin- 
burgh, a report of the second 'Daisyworld and be- 
yond' workshop, (2002), document obtained from 
http : //www. cogs . susx. ac . uk/daisyworld/ws2002_overview.htiiil 

[11] C. Tsallis, J. Stat. Phys., 52,479(1988); C. Tsallis, F. Baldovin, R. 
Gerbino and P. Pierobon, Introduction to Nonextensive Statistical Me- 
chanics and Thermodynamics, cond-mat/0309093 

[12] Q.A. Wang, Euro. Phys. J. B, 26(2002)357 

Q.A. Wang, Chaos, Solitons & Fractals, 12(2001)1431, Erranta : cond- 
mat/0009343 

[13] E.T. Jaynes, Gibbs vs Boltzmann entropies, American Journal of 
Physics, 33,391(1965); 

E.T. Jaynes, Where do we go from here? Maximum entropy and 
Bayesian methods in inverse problems, pp. 21-58, eddited by G. Ray 
Smith and W.T. Grandy Jr., D. Reidel Publishing Gompany (1985) 

[14] Q.A. Wang, Maximum path information and the principle of least action 
for chaotic system. Chaos, Solitons & Fractals, (2004), in press; cond- 
mat/0405373 and ccsd-00001549 

[15] V.L. Arnold, Mathematical methods of classical mechanics, Springer- 
Verlag, New York, 1989 

[16] R. Kubo, M. Toda, N. Hashitsume, Statistical physics II, Nonequilibrium 
statistical mechanics. Springer, Berlin, 1995 

[17] G. Beck and F. Schlogl, Thermodynamics of chaotic systems, Gambridge 
University Press, 1993 



20 



[18] Q.A. Wang, Chaos, Solitons & Fractals, 19,639(2004) 

Q. A. Wang and A. Le Mehaute, Chaos, Solitons & Fractals, 
21,893(2004) 

[19] F. Bonetto, J.L. Lebowitz, L. Rey-Bellet, Fourier's Law: a Challenge 
for Theorists, math-ph/0002052 

[20] T. Gilbert, J.R.Dorfman, and P. Gaspard, Phys. Rev. Lett., 
85,1606(2000); 

I. Glaus and P. Gaspard, The fractality of the relaxation modes in de- 
terministic reaction-diffusion systems, cond- mat/0204264 

[21] Robert G. Hilborn, Chaos and Nonlinear Dynamics, Oxford University 
press. New York, 1994 

[22] Q.A. Wang, Action principle and Jaynes' guess method, cond- 
mat/0407515 



21 



